Quality of routine health data at the onset of the COVID-19 pandemic in Ethiopia, Haiti, Laos, Nepal, and South Africa.

BACKGROUND: During the COVID-19 pandemic, governments and researchers have used routine health data to estimate potential declines in the delivery and uptake of essential health services. This research relies on the data being high quality and, crucially, on the data quality not changing because of the pandemic. In this paper, we investigated those assumptions and assessed data quality before and during COVID-19. METHODS: We obtained routine health data from the DHIS2 platforms in Ethiopia, Haiti, Lao People's Democratic Republic, Nepal, and South Africa (KwaZulu-Natal province) for a range of 40 indicators on essential health services and institutional deaths. We extracted data over 24 months (January 2019-December 2020) including pre-pandemic data and the first 9 months of the pandemic. We assessed four dimensions of data quality: reporting completeness, presence of outliers, internal consistency, and external consistency. RESULTS: We found high reporting completeness across countries and services and few declines in reporting at the onset of the pandemic. Positive outliers represented fewer than 1% of facility-month observations across services. Assessment of internal consistency across vaccine indicators found similar reporting of vaccines in all countries. Comparing cesarean section rates in the HMIS to those from population-representative surveys, we found high external consistency in all countries analyzed. CONCLUSIONS: While efforts remain to improve the quality of these data, our results show that several indicators in the HMIS can be reliably used to monitor service provision over time in these five countries.

Associations between the stringency of COVID-19 containment policies and health service disruptions in 10 countries.

BACKGROUND: Disruptions in essential health services during the COVID-19 pandemic have been reported in several countries. Yet, patterns in health service disruption according to country responses remain unclear. In this paper, we investigate associations between the stringency of COVID-19 containment policies and disruptions in 31 health services in 10 low- middle- and high-income countries in 2020. METHODS: Using routine health information systems and administrative data from 10 countries (Chile, Ethiopia, Ghana, Haiti, Lao People's Democratic Republic, Mexico, Nepal, South Africa, South Korea, and Thailand) we estimated health service disruptions for the period of April to December 2020 by dividing monthly service provision at national levels by the average service provision in the 15 months pre-COVID (January 2019-March 2020). We used the Oxford COVID-19 Government Response Tracker (OxCGRT) index and multi-level linear regression analyses to assess associations between the stringency of restrictions and health service disruptions over nine months. We extended the analysis by examining associations between 11 individual containment or closure policies and health service disruptions. Models were adjusted for COVID caseload, health service category and country GDP and included robust standard errors. FINDINGS: Chronic disease care was among the most affected services. Regression analyses revealed that a 10% increase in the mean stringency index was associated with a 3.3 percentage-point (95% CI -3.9, -2.7) reduction in relative service volumes. Among individual policies, curfews, and the presence of a state of emergency, had the largest coefficients and were associated with 14.1 (95% CI -19.6, 8.7) and 10.7 (95% CI -12.7, -8.7) percentage-point lower relative service volumes, respectively. In contrast, number of COVID-19 cases in 2020 was not associated with health service disruptions in any model. CONCLUSIONS: Although containment policies were crucial in reducing COVID-19 mortality in many contexts, it is important to consider the indirect effects of these restrictions. Strategies to improve the resilience of health systems should be designed to ensure that populations can continue accessing essential health care despite the presence of containment policies during future infectious disease outbreaks.

Tracking health system performance in times of crisis using routine health data: lessons learned from a multicountry consortium.

COVID-19 has prompted the use of readily available administrative data to track health system performance in times of crisis and to monitor disruptions in essential healthcare services. In this commentary we describe our experience working with these data and lessons learned across countries. Since April 2020, the Quality Evidence for Health System Transformation (QuEST) network has used administrative data and routine health information systems (RHIS) to assess health system performance during COVID-19 in Chile, Ethiopia, Ghana, Haiti, Lao People's Democratic Republic, Mexico, Nepal, South Africa, Republic of Korea and Thailand. We compiled a large set of indicators related to common health conditions for the purpose of multicountry comparisons. The study compiled 73 indicators. A total of 43% of the indicators compiled pertained to reproductive, maternal, newborn and child health (RMNCH). Only 12% of the indicators were related to hypertension, diabetes or cancer care. We also found few indicators related to mental health services and outcomes within these data systems. Moreover, 72% of the indicators compiled were related to volume of services delivered, 18% to health outcomes and only 10% to the quality of processes of care. While several datasets were complete or near-complete censuses of all health facilities in the country, others excluded some facility types or population groups. In some countries, RHIS did not capture services delivered through non-visit or nonconventional care during COVID-19, such as telemedicine. We propose the following recommendations to improve the analysis of administrative and RHIS data to track health system performance in times of crisis: ensure the scope of health conditions covered is aligned with the burden of disease, increase the number of indicators related to quality of care and health outcomes; incorporate data on nonconventional care such as telehealth; continue improving data quality and expand reporting from private sector facilities; move towards collecting patient-level data through electronic health records to facilitate quality-of-care assessment and equity analyses; implement more resilient and standardized health information technologies; reduce delays and loosen restrictions for researchers to access the data; complement routine data with patient-reported data; and employ mixed methods to better understand the underlying causes of service disruptions.

COVID-19 and resilience of healthcare systems in ten countries.

Declines in health service use during the Coronavirus Disease 2019 (COVID-19) pandemic could have important effects on population health. In this study, we used an interrupted time series design to assess the immediate effect of the pandemic on 31 health services in two low-income (Ethiopia and Haiti), six middle-income (Ghana, Lao People's Democratic Republic, Mexico, Nepal, South Africa and Thailand) and high-income (Chile and South Korea) countries. Despite efforts to maintain health services, disruptions of varying magnitude and duration were found in every country, with no clear patterns by country income group or pandemic intensity. Disruptions in health services often preceded COVID-19 waves. Cancer screenings, TB screening and detection and HIV testing were most affected (26-96% declines). Total outpatient visits declined by 9-40% at national levels and remained lower than predicted by the end of 2020. Maternal health services were disrupted in approximately half of the countries, with declines ranging from 5% to 33%. Child vaccinations were disrupted for shorter periods, but we estimate that catch-up campaigns might not have reached all children missed. By contrast, provision of antiretrovirals for HIV was not affected. By the end of 2020, substantial disruptions remained in half of the countries. Preliminary data for 2021 indicate that disruptions likely persisted. Although a portion of the declines observed might result from decreased needs during lockdowns (from fewer infectious illnesses or injuries), a larger share likely reflects a shortfall of health system resilience. Countries must plan to compensate for missed healthcare during the current pandemic and invest in strategies for better health system resilience for future emergencies.